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Abstract 

This paper gives a thorough overview of what is known about first-order logic 
with counting quantifiers and with arithmetic predicates. As a main theorem we 
show that Presburger arithmetic is closed under unary counting quantifiers. Pre¬ 
cisely, this means that for every first-order formula fp{y, 2 ) over the signature 
{<, -I-} there is a first-order formula 5) which expresses over the structure 
(N, <, -f) (respectively, over initial segments of this structure) that the variable x 
is interpreted exactly by the number of possible interpretations of the variable y for 
which the formula y}(y, z) is satisfied. Applying this theorem, we obtain an easy 
proof of RuhTs result that reachability (and similarly, connectivity) in finite graphs 
is not expressible in first-order logic with unary counting quantifiers and addition. 
Furthermore, the above result on Presburger arithmetic helps to show the failure of 
a particular version of the Crane Beach conjecture. 

Keywords: logic in computer science, first-order logic, Presburger arithmetic, quanti¬ 
fier elimination, counting quantifiers 
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1 Introduction 


In computational complexity theory the complexity of a problem is measured by the 
amount of time or space resources that are necessary for solving a problem on an (ide¬ 
alized) computational device such as a Turing machine. Fagin’s seminal work tied this 
computational complexity to the descriptive complexity, i.e., to the complexity (or, the 
richness) of a logic that is capable of descirbing the problem. Until now most compu¬ 
tational complexity classes have been characterized in such a des criptive way by logics 
that are certain extensions of first-order logic (cf., the textbooks [ Imm99 , EF99 |). One 
thing that most of these logics have in common is that they are powerful enough to 
ex press ari thmetic predicates such as -b, x, or Bit. 

In [ BIS90 ] it was shown that, on finite ordered structures, first-order logic with vary¬ 
ing arithmetic predicates corresponds to the circuit complexity class AC® with varying 
uniformity conditions. However, there are computationally easy problems such as the 
PARlTY-problem (asking whether the number of 1 ’s in the input string is even), that do 
not belong to AC®, i.e., that are not definable in first-order logic with arbitrary arith¬ 
metic predicates. In fact, an important feature that first-order logic lacks is the ability 
to count. 

Various different ways of enriching first-order logic with the ability to count have 
been examined in the literature. A usual approach (cf., [Imm99, ^te97 , BK97]) is to 
consider two-sorted structures that consist of a so-called “vertex domain” for the ac¬ 
tual structure and an additional “number domain” for the counting results (usually of 
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the same cardinality as the vertex domain) which may or may not be equipped with 
arithmetic predicates. However, if the actual structure is itself equipped with a lin¬ 
ear ordering, the additional number domain does not give any additional expressivity 
(since the number i can be identified with the i-th largest element in the vertex do¬ 
main; and the arithmetic predicates on the number domain can be translated into the 
corresponding predicates on the vertex domain and vice versa). In the present paper we 
will therefore avoid two-sorted structures. Instead, we will use the following approach, 
restricting attention to structures whose universe is either the set N of natural numbers 
or an initial segment of N. We enrich first-order logic by counting quantifiers of the 
form 3=^2/. For an interpretation a of the variable x, the formula <p{y) expresses 
that there are exactly a different interpretations of the variable y such that the formula 
(p{y) is satisfied. This leads to the logic called FOunC, first-order logic with unary 
counting quantifiers. Similarly, by adding quantifiers that allow to count the number of 
fc-tuples that satisfy a formula, one obtains the logic FOk-aryC, first-order logic with 
fc-ary counting quantifiers. 

In [BIS90] it was shown that, on finite ordered structures, FOunC with varying arith¬ 
metic predicates corresponds to the circuit complexity class TC° with varying unifor¬ 
mity conditions. 

In a different line of research, pure arithmetic is considered. There, the underlying 
structure is either the set of natural numbers with certain arithmetic predicates, or initial 
segments of N with arithmetic predicates — and the signature contains nothing else 
but the arithmetic predicates. The aim is to investigate and compare the expressive 
power of first-order logic with different arithmetic predicates. Concerning N, detailed 
overviews can be found in [Bes02, ECorOl]; concerning initial segments of N, we refer 
to IEM981 and the references therein. One important open question is whether the so- 
called class of rudimentary relations is closed under counting, i.e., whether on initial 
segments of (N, -f, x) first-order logic is as expressive as FOunC. 

The aim of the present paper is to 


• give an overview of what is known about the expressive power of first-order logic 
with different arithmetic predicates. The emphasis here lies on finite structures and 
initial segments of N rather than N. 


• examine in detail the expressive power of first-order logic with counting quantifiers 
and with different arithmetic predicates, for finite structures as well as for pure arith¬ 
metic on N and on initial segments of N. In particular, we will point out that on 
the (non-ordered) structure (N, x) the use of the logic FOunC does not make sense, 
since this logic lacks to have the isomorphism property on (N, x) and its initial seg¬ 
ments. I.e., for (N, x) and its initial segments the usual approach with two-sorted 
structures would be more adequate. 


• give a positive answer to the analogue of the above question on rudimentary rela¬ 
tions, for Presburger arithmetic (N, -f) rather than (N, +, x). I.e., we will show that 
on (N, -f) and its initial segments first-order logic is indeed as expressive as FOunC. 
As applications of this result we will obtain the failure of a particular version of 
the so-called Crane Beach conjecture, we will obtain an easy proof of Ruhl’s re¬ 
sult [|luh99 ] that reachability in finite graphs is not expressible in FOunC{+) and. 


3 










similarly, that connectivity of finite graphs is not definable in FOunC{+). 


Via communication with Leonid Libkin the author learned that the result on Presburger 
arithmetic was independently discovered, but not yet published, by H. J. Keisler. 

Let us mention two more papers that deal with unary counting quantifiers and with 
FO(+), respectively: Benedikt and Keisler [BK97| investigated several different kinds 
of unary counting quantifiers. Implicitly, they show that, under certain presumptions, 
such unary counting quantifiers can be eliminated (cf.. Lemma 19 in the appendix of 
[BK97]). However, their result does not deal with Presburger arithmetic and its ini¬ 
tial segments, and their proofs are non-elementary, using non-standard models and 
hyperfinite structures. Pugh [Pug94| deals with Presburger arithmetic {Z,<,+) and 
counting quantifiers from a different point of view. He presents a way of how a sym¬ 
bolic math package such as Maple or Mathematica may compute symbolic sums of the 
form 'Y^{p{y, z) : y G Z and (Z, <, -b) \= (p{y, z)}, where p is a polynomial in the 
variables y, z and p is a FO(<, -|-)-formula. The FOk-aryC-formulas considered in the 
present paper correspond to the simplest such sums in which the polynomial p is the 
constant 1. 


The present paper contains results of the author’s dissertation [ SchOl |. The paper is 
structured as follows: Section ^ fixes the basic notations concerning first-order logic. 
Section || summarizes important properties of first-order logic with arithmetic predi¬ 
cates, concentrating on its ability and its inability, respectively, to count cardinalities of 
certain sets. Section ^ fixes the syntax and semantics of first-order logic with counting 
quantifiers and exposes important properties of this logic. In Section ^ we show that 
Presburger arithmetic is closed under unary counting quantifiers. Section ^points out 
some applications of the previous section’s result: We obtain the failure of a particular 
version of the Crane Beach conjecture, and we show that reachability and connectivity 
of finite graphs are not expressible in first-order logic with unary counting and addition. 
Finally, Section ^ points out further questions and gives a diagram that visualizes the 
expressive power of first-order logic with counting quantifiers and various arithmetic 
predicates. 


Acknowledgements: I want to thank Clemens Lautemann, Malika More, and Thomas 
Schwentick for helpful discussions on the subject of this paper. Especially the proof of 
Proposition [4.1| is partly due to them. 


2 Preliminaries 

2.1 Basic Notations 

We use Z for the set of integers, N := {0,1,2,..} for the set of natural numbers, and 
N>o for the set of positive natural numbers. For € N we write W to denote the initial 
segment {0,.., N} of N. 

For a,b G ’Lws write a | 6 to express that a divides b, i.e., that b = c ■ a for some 
cG'L. We write Icmjni,.., Uk} to denote the least common multiple of ni,.., rifc G 
N>o, i.e., to denote the smallest number in N>o that is divided by rii, for every i G 
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{1,.., fc}. For n G N>o the symbol =„ denotes the congruence relation modulo n, 
i.e., for a,b G Z we have a =„ 6 iff n | a—b. The relation =„ can be extended 
to rational numbers r, s via r =„ s iff r—s = z-n for some z G Z. For a rational 
number r we write [rj to denote the largest integer ^ r, and [r] for the smallest integer 
^ r. By lg(r) we denote the logarithm of r with respect to base 2. 

By 0 we denote the empty set, |A| denotes the cardinality of a set A, and := 
{{ai,.. ,am) '■ 0,1,.., Um G A} is the set of all m-tuples in A. Depending on 
the particular context, we use a as abbreviation for a sequence oi,.., Um or a tuple 
(oi,.., Om)- An m-ary relation i? on A is a subset of A™. Instead of a G i? we often 
write R{a). 

2.2 Signatures, Structures, and Isomorphisms 

A signature r consists of (a possibly infinite number of) constant symbols, relation 
symbols, and function symbols. Each relation or function symbol S G t has a fixed 
arity ar{S) G N>o. Whenever we refer to some “R G r” we implicitly assume that 
i? is a relation symbol. Analogously, “c G r” means that c is a constant symbol, and 
“/ G r” means that / is a function symbol. 

A T-structure A = (A, r"^) consists of an arbitrary set A which is called the uni¬ 
verse of A, and a set that contains an interpretation G A for each c G r, an 
interpretation R-^ C for each R G t, and an interpretation A 

for each / G r. The structure A is finite iff its universe A is finite. 

An isomorphism tt between two r-structures A = (A,t-^) and B = {B,t^) is a 
bijective mapping tt : A ^ B such that 7r(c'^) = c® (for each c G r), R'^{d) iff 
i?®(7r(a)) (for each R G t and all a G and 7r(/-^(a)) = /®(7r(a)) (for each 

f G T and all a G A‘‘’'^^'l). An automorphism of A is an isomorphism between A and 

A. 


2.3 First-Order Logic 

Let r be a signature. We use a;i, X 2 ,... as variable symbols, r-terms are built from the 
variable symbols, the constant symbols, and the function symbols in r in the following 
way; Each constant symbol in r and each variable symbol is a r-term, and if ti,.. ,tm 
are r-terms and / is a function symbol in r of arity m, then f{ti,..,tm) is a r- 
term. Atomic r-formulas are ti=t 2 and R{ti,.., tm), where i? G r is of arity m and 
ti,.. ,tm. are r-terms. 

First-order r-formulas, for short: FO{T)-formulas, are built up as usual from the 
atomic r-formulas and the logical connectives V, the variable symbols xi,X 2 , ■ ■ 
and the existential quantifier 3. As usual, we use Va: p (respectively p A ip, p ^ ip, 
p ^ Ip) as abbreviation for Sx ^p (respectively ^(p^p V ^ip), -^p V ip, {p Aip)\/ 
{-^p A -'Ip)). 

With/ree {p) we denote the set of all variables that occur free (i.e., not in the 
scope of some quantifier) in p. Sometimes we write p{xi,.. ,Xm) to indicate that 
free {p) C {xi,.., Xm]- We say thatis a sentence if it has no free variables. We say 
that p is quantifier free if there is no quantifier in p (i.e., is a Boolean combination 
of atomic r-formulas). 
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If we insert additional relation, function, or constant symbols, e.g., < and +, into a 
signature r, we simply write FO(t, <, +) instead of FO(t U {<,+}). 

For a FO(t)- sentence Lp and a r-structure A we say that A models tp and write A \= 
If to indicate that ip is satisfied when interpreting each symbol in t by its interpretation 
in For a FO(T)-formula ip{xi ,.., Xm) and for interpretations oi,.., am G ^ of the 
variables xi,. ■, Xm, we write A |= (p{ai ,.., am) (or, equivalently, {A, ai,.., am) \= 
p{xi, .., Xm)) to indicate that the (r U {xi, .., a;m})-structure {A, oi,.., am) models 
the FO(t, a;i,.., a;m)-sentence (p. 

It should be obvious that FO(t) has the isomorphism property, i.e.; If tt is an 
isomorphism between two r-structures A and B, if <p(x) is a FO(T)-formula, and if 
a e A is an interpretation of the variables x, then A \= p{a) iff 'n{A) ^ ip{TT{a)). 

A relation R C A^ is called FO{T)-definable in A if there is a FO(T)-formula 
(p{xi,..,Xm) such that R = {{ai,..,am) & ■. A \= ip[ai,.. ,am)}- Ac¬ 

cordingly, a function / : A™ ^ A and an element a G A are called FO(T)-dehnable in 
A if the corresponding relations i?/ := {(oi,.., Um, /(oi,.., am)) '■ (oi, • •, a™) € 
A"*} and Ra := {a} are FO{T)-definable in A. 

We say that two FO(r)-formulas (p{x) and ipix) are equivalent over A if, for all 
interpretations a S A of the variables x, we have A ^ pia) iff A \= ip{a)- Accord¬ 
ingly, if AG is a class of r-structures, we say that (p{x) and ip{x) are equivalent over 
AG, if they are equivalent over every structure A € AG. 

3 First-Order Logic with Arithmetic 

In this section we summarize important properties of first-order logic with arithmetic 
and we point out the correspondence between first-order logic with arithmetic and cir¬ 
cuit complexity on the one hand and rudimentary relations on the other hand. 


3.1 Arithmetic 

In this paper we consider the following arithmetic predicates on N and on initial seg¬ 
ments N of N: 

• the binary linear ordering predicate <, 

• the ternary addition predicate +, consisting of all triples [x, y, z) such that x+y = z, 

• the ternary multiplication predicate x, consisting of all triples {x,y,z) such that 
X ■ y = z, 

• the ternary exponentiation predicate Exp, consisting of all triples {x, y, z) such that 
xy = z, 

• the binary Bit predicate Bit, consisting of all tuples {x, y) such that the y-th bit in 
the binary representation of x is 1, i.e., is odd, 

• the unary square numbers predicate Squares, consisting of all numbers n^, for all 
n gN. 
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When speaking of arithmetic on finite structures we consider a set 21 of arithmetic 
predicates. Furthermore, we consider arbitrary signatures t and all r-structures whose 
universe is an initial segment of N. Given such a r-structure A = {N_, r'^) we enrich A 
by the arithmetic predicates in 21. I.e., we move over to the (rU2l)-structure (-4,21) := 
{N_, 21^), where 21^ is the collection of the relations := P n for all 

P G 21. Usually we will suppress the superscript N and simply write 21 instead of 21^ 
and P instead of . 

In contrast to arithmetic on finite structures, pure arithmetic means that we restrict 
our attention to structures where the signature r is empty. I.e., we only consider the 
structure (N, 21) and the structures (W, 21^^), for all TV G N. 

To compare the expressive power of different sets of arithmetic predicates, we fix 
the following notation. 

3.1 Definition. Let 2li and %2 be classes of arithmetic predicates, i.e., subsets of {< 

, +, X, Exp, Bit, Squares}. 

(a) The statement “FO(2ti) C FO( 2 l 2 ) on N” has the following precise meaning: 
For every FO{%i)-formula piix) there is a FO{% 2 )-formula P 2 {x) such that 
“(N,2ti) 1= i^i(a) iff (N, 2 t 2 ) |= (^ 2 ( 0 )” is true for all interpretations a of 
the variables x. 

(b) The statement “FO(2li) C FO(2l2) on initial segments of N” has the following 
precise meaning: For every FO{%i)-formula pi{x) there is a FO{% 2 )-formula 
P 2 {x) such that “(TV,2li) ^ <Fi(®) W {fLi'^ 2 ) H ‘F 2 (®)” F true for all 
N G N>o and all interpretations a G TV of the variables x. 

(c) The statement “FO(2li) C FO( 2 l 2 ) on finite structures” has the following pre¬ 

cise meaning: For every signature r and every FO(2li, T)-formula pi{x) there is 
aFO{% 2 ,T)-formula Lp 2 {x) such that “(TV,2li,r'^) \= pi{d) iff (TV,212,t-^) H 
<P2{3)” is true for all N G for all r-structures A = and for all 

interpretations a G N_ of the variables x. □ 


3.2 Expressive Power 

The expressive power of first-order logic with arithmetic predicates <, +, x, etc. is by 
now well understood: 

FO(<) C FO(+) C FO(+, x) and 

FO(+, x) = FO(<, x) = FO{Bit) — FO{-\-, Squares) 

— FO{<, +, X, Exp, Bit, Squares) 

on initial segments of N (and on finite structures and on N). 


More precisely: 

. FO«) c FO(+) is true, because, on the one hand, “<” can be expressed us¬ 
ing “-f”, and on the other hand, there is a FO(-f )-formula, but no FO(<)-formula 
which expresses that the cardinality of the underlying universe is even (cf., e.g., the 
textbook [EF99, Example 2.3.6]). 
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FO(+) c FO(+, X) is true, because, there is a FO(+, x )-formula, but no FO(+)- 
formula which expresses that the cardinality of the underlying universe is a prime 
number. This is a direct consequence of the Theorem of Ginsburg and Spanier which 
states that the spectra of FO(+)-sentences are semi-linear, i.e., for every FO(+)- 
sentence (p there are numbers p,Nq G N such that for every TV > TVq we have 
(JV,-h) H F iff (-iV+p, +) \= <p. A proof of the Theorem of Ginsburg and 
Spanier, based on Presburger’s quantifier elimination, can be found in the textbook 


Corollary 8.5]. 


[ lSmo9ll Theorem 4.10]; an Ehrenfeucht-Fraisse game proof is given in [lSch0l| 


• FO(+, X) = • • • = FO(<, +, X, Fxp, Bit, Squares) is true because of the fol¬ 
lowing: 

3.2 Theorem. There is 


(a) a FO{Bit)-formula Lp^{x,y), such that for every N G N>o and all assignments 
x,y G N_ of the variables x, y, we have {ff, Bit) ^ {x,y) iff x < y. 


(b) a FO{Bit)-formula <p+{x, y, z), such that for every N G N>o and all assignments 
x,y,z G N_ofx,y,z,we have {N_,Bit) \= (p+{x,y, z) iff x + y = z. 

(c) a FO{Bit)-formula ipx (x, y, z), such that for every N G N>o and all assignments 
x,y,z G N_ ofx, y, z, we have (TV, Bit) \= px {x, y,z) iff x x y = z. 

(d) a FO{<, x)-formula (psitix, y), such that for every TV G N>o and all assignments 
x,y G N_ of the variables x, y, we have (TV, <, x) ^ (fBkix, y) iff Bit(x, y). 


(e) a FO(+, X )-formula (pExp{x, y, z), such that for every TV G N>o and all assign¬ 
ments x,y, z G N_ ofx, y, z, we have (TV, -p, x) ^ <PExp{x, y, z) iff x = y^. 

(f) a FO(+, Squares)-formula (px (x, y, z), such that for every TV G N>o and all as¬ 

signments x, y, z G N_of x,y,z, we have (TV, +, Squares) ]= px{x,y,z) iff 
x X y = z. □ 


Proof. The proofs of the parts (a)-(e) are very in volved. 

Part (a) was shown by Dawar et al. in [ DDLW98 ]. _ 

FO(<,Bit)-formulas for (b) and (c) are outlined in the textbook [Imm99|, where also 
the construction of a FO(<, +, x)-formula for (d) is described. Troy Lee observed in 
an email note to Immerman and Barrington that in this construction all the uses of + 

can be replaced using <, and thus < and x suffice to express Bit. _ 

Part (e) was shown by Bennet in [Ben62| (see also Lindell’s email note (Lin95|). 

The proof of part (f) is not so difficult: 

Step 1 is to construct a FO(+, Squares)-formula 'f{u, v) expressing that = v. 
Here, one can make use of the equation (u — 1)^ = vf — 2u+ \ which gives us that 
vf = V IS valid if and only if 


— u is a square number, i.e., Squares{v), and 

— (u = 0 and u = 0) or (u = 1 and v = 1) or 

— for the number w that is the predecessor of v in the set Squares we 
have that w = v — 2u + 1. 










It is straightforward to express this by a FO(+, Squares)-formula '0(x, y). 

Step 2 is to construct a FO(+, Squares)-formula {x, y, z) expressing that xxy = 
z for numbers x, y of size at most ^/N (when considering the universe {0,.., N}). 
Here, one can make use of the equation {x — y)^ = x^ — 2xy + y^ which gives 
us that X X y = z if and only if the equation w = u — 2 z + v is true for the 
numbers u := x^, v := y^, and w := {x—yY- Using the formula ip from Step 1, it 
is straightforward to express this by a FO(+, Squares)-formula (x, y, z). Note that 
this formula defines the multiplication x only for numbers x, y of size at most VN, 
where N is the maximum element in the universe. 

Step 3 is to lift the multiplication fr om num bers of size up to VN to numbers of 
size up to N. Such a lifting is proved in | Lyn82| , Lemma 1 (ii)]. The details are similar 
to the details in Step 2 of the proof of Theorem ^^(d) in the appendix of the present 
paper. The basic idea is the following: 


1. For numbers x G {0,.., N} use the (M+l)-ary decomposition x = xi ■ (M+1) + 
xo, where xi,xo ^ M and M := 

2. Show that this decomposition is definable via a FO(+, Squares)-formulax(a:, xi, Xq)- 

3. Use ip'^ to construct a formula (xi, Xq, yi, t/o; -^i, zq) that defines the multipli¬ 
cation for the (M-l-l)-ary decompositions of numbers x, y, z. 


Finally this leads to the desired FO(+, Squares)-formula that defines multiplication of 


numbers of size up to N. Hence, the proof sketch for part f/j of Theorem 3.2 
plete. 


It is easy to see that “<” cannot be expressed using “x” alone, i.e., 

FO(x) C FO(<, x) on initial segments of N (and also on finite 
structures and on N). 

To see this, let A be either the structure (N, x) or some initial segment (^, x). For the 
sake of contradiction, assume that there is a FO( x )-formula (x, y) expressing that 
a<h, for all interpretations a, 6 € ^ of the variables x, y. The isomorphism property of 
FO( X) thus implies, for every automorphism tt of A, that 7r(a)<7r(6) iff a<b. Hence, 
the identity function on A is the only automorphism of A. 

The contradiction now follows from the fact that (N, x) and also most initial segments 
( N . X) do have automorphisms different from the identity function: Indeed, over N, the 
role of any two different prime numbers p and q is interchangeable. I.e., the following 
mapping iTp^q is an automorphism of (N, x): iTp^q is determined via TTp^q (axb) = 
TTp^q (a) X TTp^q (6) for all a, 6 € N>o, and, for all prime numbers r, 

i q if r = p 
p if r = q 
r if r ^ p, q is a prime. 

Moreover, if p and q are prime numbers > then iTp^q can even be viewed as an 
automorphism of the initial segment (^, x). In fact, iTp^q leaves all elements in ^ 
fixed except for p and q. For example, ^ 2^3 is an automorphism of (3, x), and 


9 






is an automorphism of (8, x). Moreover, from results in number theory (cf., e.g., 
[Ros94, Problem 17 in Chapter 13]) we know that for any large enough N there are 
prime numbers p, q with ^- < p < q ^ N. 

What we have seen is that there is no FO(x)-formula(/j<(a::,y) such that “(iV, x) ^ 
V3< (a, b) iff a<b” is true for all N G N>o and all a^b G N_. It is remarkable, however, 
that “<” is indeed FO( x )-definable on numbers of size up to ^/N : 


3.3 Lemma (Folklore). There is a FO{x)-formula ip'^(x,y) which defines “<” on 
numbers of size up to s/N. I.e., for all N G N>o and all interpretations a.b G N of 
the variables x, y, we have {N_, x) |= (a, b) iff a < b ^ s/N. □ 

Proof. The FO( X )-formula {x, y) is defined via 

3z xxx=z A 3z yxy=z A 3u [(3v xxu=v) A [-^3v'yxu=v')). 


For the “only if” direction let a,b G N_ such that (TV, x) |= ff^{a,b). Clearly, the 
first two conjunctions of ensure that a,b ^ s/N. The third conjunction ensures 
that there is some u G N_ such that axu ^ N and bxu > N, and hence, in particular 
a < b. 

For the “if” direction let a < 6 ^ '/N. In particular, axa ^ N and bxb ^ N, and 
hence the first two conjunctions of are satisfied. Choose u G N, maximal such that 
axu ^ N. In particular, u ^ a, and there is some r with 0 ^ r < a ^ u such that 
N = axu + r. Since b ^ a+1 we thus have bxu ^ (a+1) x u = axu + u > 
axu + r = N. Hence, also the third conjunction in is satisfied. ■ 


When considering an initial segment N_, the relations <, +, x. Bit can a priori speak 
only about numbers of size at most N. This can be improved up to N‘^ (for any 
fixed d G N>o) by using (W+l)-ary representations of numbers: We use a d-tuple 


X := (xd-i, .. ,a;o) G (iV)“ 

Theorem 3.4 shows that 


to represent the number Xi(N+l)’'. The following 


the d-tuple versions of <, +, X, and Bit, respectively, are first-order 
definable on initial segments of N. 


This fact has been observed and used in various places, e.g., [Har73, 4ts99]. 
3.4 Theorem (Folklore). For every d G N>ci there is 


(a) a FO{<)-formula p'^{xd-i, ■ ■, xo, Vd-i, ■ ■, yo), such that for every N G N>o and 

all assignments x,y G N_ of the variables x, y, we have (TV, <) |= {x, y) iff 

(b) a FO{+)-formula p^^Xd-i, ■ ■ ,Xo, Vd-i, ■ ■ ,yo, Zd, ■ ■, Zq), such that for every N G 
N>o and all assignments x,y,z G N_ of the variables x, y, z, we have 

{N, <, +) h (x, y, z) iff 

Y.tlxi{N+iY + Y.tlyi{N+iy = Y.U^i{N+iy. 

(c) for every fixed n G N>o, a FO{+)-formula p^^{xd-i, ■ ■ ,Xo,yd-i, ■ ■ ,yo), such 

that for every N G N>o and all assignments x,y G N_ of the variables x, y, we 
have (TV, <,+) 1= iff =n T,tZo Vi i^+^Y- 
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(d) a FO{+, x)-fonnula ip‘^ {xd-i, ■■ ,xo, Vd-i, ■ •, 2/o, Z 2 d-i, ■ ■, zo), such thatfor ev¬ 

ery N S N>o and all assignments x,y, z G iV o/ the variables x, y, z, we have 
(iV,+, x) ^ ijf 

X Etoy^^+ir = Y.T=t^i{N+i)\ 

(e) a FO{Bit)-formula (p^“(xd-i, ■ ■ ^xojy), such thatfor every N G N>o and all 

assignments x,y G N_ of the variables x, y, we have {f£, Bit) ^ ip^-fx, y) iff 
the y-th bit in the binary representation of Xi{N-\-iy is 1.. □ 

The proof of Theorem |3.4| is straightforward but tedious. For the sake of completeness 
— since the author does not know references that contain complete proofs of all parts 
of this theorem — a proof is given in the appendix. 


3.3 Counting vs. Arithmetic on Finite Structures 


There is a close connection between arithmetic on finite structures and circuit complex¬ 
ity. A concise overview of circuit complexity can be found in [ A1196]. The complexity 
class ACP consists of all problems solvable by polynomial size, constant depth circuits 
of AND, OR, and NOT gates of unbounded fan-in. It was shown in [ BIS9C ] that, for 
ordered structures over arbitrary signatures r, logtime-uniform AC° is exactly the class 
of all problems definable in FO(-|-, x, r). It is a deep result of [ Ajt83, FSS84| that 


Parity := {(iV,<,Y') : A € N>o, r c TV, |r|iseven} 

does not belong to AC°, and hence is not definable in FO(-|-, x, F). This is known even 
for non-uniform AC°, which translates to FO(2trb, Y), where 2trb is the collection of 
arbitrary, i.e. all, built-in predicates on initial segments of N. From [ pKPS85 , DGS86] 
we also know that, for any e > 0, FO(2lrb, Y) cannot count cardinalities of sets up to 
size N^: 


3.5 Theorem (FO(2lrb) cannot count on finite structures). 

Let e > 0. There is no FO(2lrb, Y)-formula x#{x, Y) such that 

{N,^xb,x,Y) ^ XaixX) iff x=\Y\^N^ 


is true for all N G N>o, all Y Q and all x G N. 


□ 


However, it was shown in [ FKPS85 , DGS86 , ^B84] that, for any c G N>o, FO(+, x,Y) 
can indeed count cardinalities of sets up to size (Ig N)'^: 


3.6 Theorem (Polylog Counting Capahility of FO(-F, X)). 

For every c G N>o there is a FO{+, X, Y)-fonnula X%{x, Y) such that 


{N,+,x,x,Y)^xU^,Y) iff x = \Y\^{\gN)- 


is true for all N G N>o, all Y C ^ and all x G N. 


□ 


A self-contained, purely logical proof of this theorem can be found in [ DLM98]. 
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3.4 Counting vs. Pure Arithmetic on Initial Segments of N 


There is a direct correspondence between pure arithmetic FO{+, x) on initial segments 
of N and bounded arithmetic Aq on N. Aq is the class of all FO{+, x)-formulas in 
which quantified variables are bounded by other variables via 3x {x^y A ...). The 
Ao-definable relations in N are calle d the ru dimentary relations. A recent overview of 
this line of research can be found in [ |EM98 |, where it is also pointed out that there is a 
precise correspondence between 


(1.) the FO(+, x)-definable spectra (the spectrum of a FO{+, x)-sentence ip is the 
set of all N S N>o such that (A, +, x) ^ p). 


(2.) the unary rudimentary relations, 


(3.) the linear hierarchy L7JVH, and 

(4.) the string languages definable in monadic second order logic MSO{+). 


Researchers concerned with rudimentary relations have developed clever encoding 
techniques that expose the expressive power of bounded arithmetic. For example, the 
exponentiation relation x=y^ was proved to be rudimentary (and hence FO{+, x)- 
definable on in itial segments of N) already in 196 2 by B ennet [ Ben62 |. Further¬ 
more, Theorem [3.4| corresponds to Harrow’s result [ |dar73 1 that, for expressing rudi¬ 
mentary relations, one may make use of polynomially bounded quantification such as 
3x {x^y‘^ A ...). Esbelin and More [EM98] developed a toolbox that allows to express 
certain primitive recursive functions by Ag-formulas. 

On the other hand, hardly any tools are known which enable us to prove that some 
relation is not rudimentary. According to [ |5M98 PW86] it is still open whether the 
rudimentary relations are closed under counting. Translated into the setting used in the 
present paper, this corresponds to the following: 


3.7 Question. Is there, for every FO(-|-, x)-formula p(y,z), a FO{+, x)-formula 
x{x, z) such that 


(A,+, x) h iff X = |y(jv,v,5-)| 

is true for all N G N>o, for all x, z € Nj and for the set Y(N,cp,z) '■= {v ^ IL '■ 
(iV;,+, x) ^ (/j(y,£)}. □ 


Note that the non-counting capability formulated in Theorem 3.5 does not imply a 


negative answer to the above question: In the highly involved proofs of [FKPS85 


DGS86] it is essentially used that there are lots of different possible interpretations of 
the set Y, whereas in Question 3.7 the set Y is defined by a FO(-|-, x )-formula and has 
thus exactly one interpretation. 

In fact, in [ PW86| ] it was shown that the following approximate counting is in¬ 
deed possible for rudimentary relations: For every e > 0 and every FO(+, x )-formula 
p{y, z) there is a FO(+, x)-formula x(a:, z) such that the following is true for every 
N G N>o and all z G N: 

(1.) there is exactly one x G N_ with (A, x) ^ x{x, z), and 
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(2.) for this a; we have |Y( 


{N,(p,z) 


^ £C < lYi 


(N,ip,z) 


|l+e 


Paris and Wilkie conjecture that Question 3.7 has a negative answer (without giving 
any evidence, except for the fact that known techniques do not enable us to give a pos¬ 
itive answer). Let us remark, however, that a negative answer would have the serious 
complexity theoretic consequence that LINH ^ ETIME, where ETIME denotes the 
class of all problems solvable on a deterministic Turing machine in linear exponential 
time This can be seen as follows: A negative answer to Question would 

imply that EO{+, x) is strictly less expressive than least fixed poitUhgic LEP{+, x) 
on initi al segments of N. However, it has been mentioned in [ AK99 1 and proved in 
[ Ats99 , Theorem 14] that EO{+, x) 7 ^ LFP(+, x) on initial segments of N if and only 
if LINH ETIME. The efforts to separate EO from LEP on various kinds of ordered 
structures are subsumed under the keyword the Ord ered Co njecture. An overview of 
what is known about this conjecture can be found in [ AK991. 


In the subsequent sections of this paper we consider the expressive power of the logic 
one obtains by extending hrst-order logic with the ab ility to count. In Section ^ we 
will give a positive answer to the analogue of Question [3.7| which speaks about FO(-f) 
rather than FO(+, x). 


4 First-Order Logic with Counting Quantifiers 

In this section we hx the syntax and semantics of hrst-order logic with counting quan- 
tihers, and we summarize some important properties of this logic. In particular, we 
show that on Skolem arithmetic (N, x) and its initial segments it fails to have the iso¬ 
morphism property. 

4.1 Syntax and Semantics 

First-order logic with unary counting quantihers, EOunC, is the extension of hrst-order 
logic obtained by adding unary counting quantihers of the form 3^^y. For an interpre¬ 
tation X of the variable x, a formula <p{y) expresses that there are exactly x many 
different interpretations y of the variable y such that the formula ip{y) is satished. 
Accordingly, for k G N>o, hrst-order logic with fc-ary counting quantihers, EOk-aryC, 
is the extension of hrst-order logic obtained by adding fc-ary counting quantihers of 
the form 3=^^^- ■ ’^>‘yi,.. ,yk, which allow to count the number of interpretations of 
fc-tuples (j/i,.., yk) of variables. 

To be precise: Let k € and let r be a signature. The class of POk-aryC{T)- 
formulas is obtained by the extension of the calculus for FO(t) via the following rule: 

If ip is a EOk-ary C{t) -formula and xi,.. ,Xk and yi,.. ,yk are distinct 
variables, then ■ '^’°yi,.. ,yk if is a POk-aiyC{T)-formula. 

The variables t/i,.., are bounded by this quantiher, whereas the variables xi,.. ,Xk 
remain free, i.e.,/ree (p) = {x} U (free (ip) \ {y}). 
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We will evaluate FOfc-aryC(T)-formulas only in structures whose universe is Z, N, 
or some initial segment of N. For such a structure A, the semantics of a FOk-aryC{T)- 
formula of the form 3r^y ^{x, y, z) is defined as follows: For interpretations x,z G A 
of the variables x, ^ we have 

{A,x,^ ^ 3=^y ip{x,y,z) 

iff 

Xi-\A\'^-^ = \{{y)eA'^ : {A,x,y, z) \= ip{x,y, z)} \. 

For infinite A this in particular implies that Xk is the only variable in x which may 
be interpreted by a number different from 0. For finite A = N_, the formula 3^^y(p 
expresses that that the /c-tuple x is the (iV+l)-ary representation of the number of k- 
tuples y which satisfy tp. 

To denote first-order logic with unary and binary counting quantifiers, respectively, we 
write FOunC and FObinC instead of FOl-aryC and F02-aryC. 

4.2 The Isomorphism Property 

For any reasonable logical system one requires it to have the isomorphism porperty. 
In the present setting this means that the evaluation of a FOA:-aryC(r)-formula ‘p{x) 
makes sense only for r-structures A with universe Z, N, or TV (for some N G N), that 
have the following property 

(*) : If TT is an automorphism of A and a G Ais an interpretation 
of the variables x, then A ^ p{S) iff A |= Lp{T:{a)). 

This property is, of course, true for rigid structures, i.e., for structures which have no 
automorphisms except for the identity function. In particular, structures with a discrete 
linear ordering, such as (Z, <), (N, <), {N_, <), and their extensions, are rigid. There¬ 
fore, it does make sense to study the expressive power of FOk-aryC-fonnulas on those 
structures. 

But what about Skolem arithmetic (N, x) and its initial segments {N_, x)? In Section 
we have already seen that these structures are not rigid. There, we have observed 
that the mapping iTp^g (which interchanges the prime numbers p and q and which 
leaves fixed all other prime numbers), is an automorphism of (N, x), and, as soon as 
p,q > Y’ even an automorphism of (TV, x). However, the non-rigidness does not 
necessarily imply that FOk-aryC does not have the isomorphism property on these 
structures. Nevertheless, for any k G N>o, FOk-aryC{x) does indeed neither have the 
isomorphism property on (N, x) nor on the class of initial segments of (N, x): 

4.1 Proposition. 

(a) FOunC{ X) does not have the isomorphism property on (N, X). 

(b) FOunC{x) does not have the isomorphism property on {{ff, x) : TV e N>o}. 

□ 
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Proof, (a): The failure of the isomorphism property of FOunC(x) on (N, x) is a 
direct consequence of the fact that < is FOunC(x)-definable on N. I.e., there is a 
FOunC( x)-formula (f^{x,y) such that “(N, x) ^ (p^{a,b) iff a<b” is true for all 
a,b G N. For the construction of the formula ip^{x, y) note that x<y is true if and 
only x ^ y and there are a prime number p and p-powers u and v such that u = p^, 
V = p^, and u \ V. Furthermore, 

• “u I u” can be expressed in FO( X) via “3 m; (mx?m=m)”, 

• “p is a prime number” can be expressed in FO(x) via 
“PT^l A Vw {w \ p) ^ {w=l V w=p)”, 

• “u is a power of the prime number p” can be expressed in FO( x) via 
“p is a prime number A Vg (q j u A g is a prime number) —s- q=p”, 

• “u = p^” can be expressed in FOunC(x) via 

“u is a power of the prime number p A 3 ^^mi (w^u A w \ u)”. 

Altogether, this gives us the desired FOunC(x)-formula ip<{x, y). 

To see that the isomorphism property (*) is not satisfied, letp, q be prime numbers with 
p < q, and let tt := TTp^q be the automorphism of (N, x) which interchanges p and q. 
Clearly, we have (N, x) ^ p<(p, g), but (N, x) ^ (p< ( 7 r(p), 7 r(g)). 


(b): Note that the formula {x, y) of part fa) is of no use here, because it gives us 
“<” only for numbers of size up to Ig N when A. is the underlying universe — and from 
Lemma 3.3 we know that “<” is FO( x )-definable even for numbers of size up to ^/N. 
However, the failure of the isomorphism property of the logic FOunC{ x) on the class 
{{iLj x) ■. N G N>o} can be obtained as follows: Consider the FOunC{x )-formula 


'(/'(a;) := 3 “p ^(p is a prime number). 


Of course we have, for all N G N>ci and all interpretations a € A of the variable x, 
that (A, x) \= tfj{a) iff a = |{&G A : 6 is not a prime number} |. 

However, for A := 8 and p := 5 and q := 7, the mapping tt := iTp^q is an automor¬ 
phism of (A, X), for which the property (*) describing the isomorphism property is not 
satisfied: The set of non-prime numbers in A is {0,1,4, 6,8}. This set has cardinality 

p=5, and thus we have (A, x) \= ilj{p), but (A, x) ^ ipl^TTp^q (P))- _, 

Let us mention that from the Prime Number Theorem (cf., e.g., [ |Ros94| ]) it fol¬ 
lows that for any Aq there are a A ^ Aq and two different prime numbers p, q with 
Y < P,q ^ N such that (A, x) ^ '0(p), but (A, x) ^ ^/;(7rp^q(p)). I.e., the 
isomorphism property of FOunC( x ) cannot be obtained by resticting considerations to 
initial segments that are “large enough”. ■ 


4.3 Easy Facts and Known Results 

For the rest of this paper we will concentrate on first-order logic with counting quanti¬ 
fiers on rigid structures such as (A, <) and (A, -f). It is obvious that 
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+ is definable in FOunC{<) 

on initial segments of N, on finite structures, and on N, 

via the formula ip+{x, y, z) := {x < u ^ z). Furthermore, 

X is definable in FObinC{<) 

on initial segments of N, on finite structures, and on N, 

via the formula (px{x,y,z) := {1 ^ u ^ x A 1 ^ v ^ y). This is true 

because 

X X y 

X X y = '^y = = |{(u, v) : 1 ^ x A 


It is not difficult to see the following: 

4.2 Proposition. 

For all k € N>o, FOk-aryC{+, x) = FO(+, x) on N. □ 


Proof. We encode a finite set Y by the unique number u which satisfies, for all y G N, 
that Bit{u,y) iff y G Y. The FO(+, x)-formula (fBit{u,y) from Theorem 3.2 hence 
expresses that y belon gs to the set encoded by u. Furthermore, from the counting 
capability of Theorem ^ we obtain a FO(+, x)-formula (fiBiTSUM{x,u) expressing 
that X is the number of y € N which satisfy Bit{u,y). I.e., (Pbitsum{x,u) expresses 
that X is the cardinality of the set encoded by u. 

Now, a given FOunC{+, x)-formula 3^^y ip{x,y, z) is equivalent over N to the 
FO(+, x)-formula 


3u (^'Fbitsum{x,u) a Vy {(pBitiu,y) ^ -ip{x,y, z))'^ . 


Here, u encodes the set of all y satisfying ij;- 

For a given FOk-aryC{+, x )-formula it hence suffices to find an equivalent formula in 
FOunC{+, x). 

We encode a tuple (yi,.., y^) G by the single number v = where 

Pi denotes the i-th largest prime number (for * G {1, • •, k}). A given FOfc-aryC(+, x)- 
formula ■ ’“'“yi, ■ ■ ,yk thus equivalent over N to an FOunC(+, x)- 

formula which expresses that 


xi={) A • • • A a;fc_i=0 A 3 (3yi- ■3ykV = pf ■ ■ -pf A tp{x,y,z)) . 


This completes the proof of Proposition 


Note that the above proof does not work for initial segments of N, because the number 
u which encodes a finite set Y is exponentially larger than the elements of Y. Indeed, 
it is still open whether FO(+, x) = FOunC{+, x) on initial segments ofN. However, 
from Theorem 3.5 we know that FO(+, x) ^ FOunC{+, x) on finite structures. 
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It was shown in [ BIS9C ] that, for ordered finite structures over arbitrary signatures r, 


the class of problems definable in FOunC{+, x, r) is exactly the (logtime-uniform ver¬ 
sion of the) circuit complexity class TC°.[] It is a deep result, following from [BIS90|, 
that for all k € 

FOk-aryC(+, x) — FOunC(+, x) 

on finite structures and on initial segments of N. 


Actually, in Proposition 10.3 of [ BIS9C ] it is shown that a binary counting quantifier 
can be expressed using unary majority quantifiers and the Bit predicate. Here, a unary 
majority quantifier Myip{y) expres ses that more than half of the interpretations of y 
do satisfy (p{y). The proof of [ |BIS9C ] easily generalizes from binary to k-ary counting 
quantifiers, leading to the result that FOk-aryC{+, x) = FOunC(+, x) = FOunM{<, 
Bit) = TCf'. (Note that the unary majority quantifier My(p{y) can easily be expressed 
using unary counting via 3u3vu>v A 3^ '^y ipjy ) A 3^'"y ^(p{y).) 

Barrington, Immerman, and Straubing [ BIS9C| ] also gave a logical characterization 
of the class TC° which does not need the Bit predicate, i.e., which does not need -f 
and x: They proved that TC° = FObinM{<) on finite structures. Here, FObinM is 
the extension of first-order logic obtained by adding binary majority quantifiers of the 
form Mx, y >f{x, y), expressing that more than half of the interpretations of {x, y) do 
satisfy (p{x, y). 

In [LMSVOl, Corollary 4.4] it was shown that FOunM{<) C FObinM{<) on finite 
structures. Although formulated in the terminology of certain groupoidal Lindstrom 
quantifiers, their proof basically shows the following: For pure arithmetic on initial 
segments of N, all FOunM(<)-definable spectra are also definable in FO{<, -f). 

Concerning the power of FO(<,-|-) for pure arithmetic, the main result of the 
following section goes one step further: In Theorem Corollary ^.lOj , and Corol¬ 
lary 5.11 we will show that 


FO(<,+) = FOunCi<,+) 

on Z, on N, and on initial segments of N. 

Altogether, we now have a complete picture of the expressive power of first-order logic 
with counting quantifiers and arithmetic. This picture is visualized in Figure ^ and 
Figure || at the end of this paper. 


5 Presburger Arithmetic is Closed Under Unary Count¬ 
ing Quantifiers 


In this section we show that FOunC{<, +) = FO(<, -|-) on initial segments of N, on N, 
and on Z. An important tool for our proof will be Presburger’s quantifier elimination 
[ Pre30 | which states the following: 

Every FO(<, +)-formula (p{x) is equivalent over Z to a Boolean combination of atoms 


*By definition, the class TC® (in the literature sometimes also denoted ThCP) consists of all problems 
solvable by uniform polynomial size, constant depth circuits of AND, OR, NOT, and THRESHOLD gates 
of unbounded fan-in. 
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of the form t = t', t < t', and t =„ t', where| t and t' are terms built from the 
constants 0 and 1, the variables x, and the addition/wncfion /+. Essentially this means 
that FO{<, +) over Z can express equality, inequality, and residue classes of terms — 
and nothing else! A well-presented proof of Presburger’s quantifier elimination can be 
found, e.g., in the textbook [Smo91, Chapter III.4]. 


5.1 Basic Facts Concerning Presburger Arithmetic 

We define the Presburger signature ipresb to consist of all predicates needed for Pres¬ 
burger’s quantifier elimination. I.e., ipresb := {0, 1, /+, <, } consists 

of constant symbols 0 and 1, a binary function symbol /+, a binary relation symbol <, 
and binary relation symbols =„, for every n G N>o. When considered over the uni¬ 
verse Z or N, these symbols are always interpreted in the natural way via the numbers 
0 and 1, the addition function, the linear ordering, and the congruence relation mod¬ 
ulo n. It should be obvious that these predicates are FO(-f )-definable in (N, -f) and 
FO(<,+) -definable^ in (Z, Speaking about Presburger arithmetic, we there¬ 
fore refer to one of the structures (Z, ipresb), (Z, (N, ^Presb), (N,-f). 

From Presburger’s quantifier elimination we know that the structure (Z, ‘Presb) has 
quantifier elimination. I.e., every FO(!Presb)-formuIa is equivalent over (Z, ipresb) to 
a Boolean combination of atomic !presb-formulas. Moreover, in this Boolean combi¬ 
nation of atoms, the negation ^ is not needed, because 

• -^ti=t 2 can be replaced by ti<t 2 V t 2 <ti , 

• -^ti<t 2 can be replaced by ti=t 2 V t 2 <ti, and 

• -^ti=nt 2 can be replaced by 

tl =n ^2 + 1 V ti =n f2 + l + l V • • • V t\ =„ t 2 -\-{n—\)-\ . 

Hence Presburger’s quantifier elimination can be formulated as follows; 

5.1 Theorem (Presburger’s Quantifier Elimination). Every FO(^xzsb)-formula 
ip{z) is equivalent over (Z, ^resb) to a formula of the form Vi=i Aj=i j' (-A : where 
the Uij are atoms built from the symbols in {=} U (presb U {z}. □ 

In order to gain full understanding of Presburger arithmetic, let us have a look at what 
the ^resb-atoms may express; 

Let y and z = zi,.., z,j he distinct first-order variables. A !presb-atom a{y, z) 
is built from the symbols in {=} U {0,1, /+, <, =n ; n € N>o} U {y, z}. For better 
readability we will write + instead of /+. I.e., a is of the form 

(*) : ui H- +Uk IK H- \-vi 

where k is an element in {<, =, =„ ; n G N>ci}, and ui ,.., Uk, vi,.. ,vi are (not 
necessarily distinct) elements in {0,1, y, z}. 

^Recall that =n denotes the congruence relation modulo n. 

^Note that -|- alone is not sufficient here, because the order relation “<” (respectively, the unary relation 
“>0”) are not FO(+)-definable in (Z, -|-). 


18 




Let mi, TTiy^ rnz ^,.., ruz^ be the number of occurrences of the constant 1, the variable 
y, and the variables zi,.. respectively, on the left side of (*). Similarly, let ni,ny, 
nzi, ■ ■, nz^ be the corresponding multiplicities for the right side of (*). Interpreted in 
the structure (Z, ipresb), the atom (*) expresses that 

mi-1 + niy-y + '^niz^-Zj x ni-1 + Uy-y + '^UzyZj , 
f=i 

which is equivalent to {my—ny)-y x (m—mi)-l + '^j^i{nzj—mzj)-Zj . 

I.e., there are c, d, A:i,.., S Z such that (*) is equivalent to 


V 

(**) : c-y X d + '^^kjZj. 

i=i 


In case c = 0, (**) is equivalent to 0 x d + ^ ^ =}> (**) 

is equivalent to y x i (d + ^j^j) if c > 0, and to (d + ^ V 

c < 0. 

It remains to consider the case where c 7 ^: 0 and x is a congruence relation =„ for some 
n € N>o. The following Lemma 5.2 shows that in this case there are d', € Z 

and c', n' € N>ci such that (**) is equivalent to y =„' ^ (d' + 'YTj=i 


5.2 Lemma. Let 0 c € Z and n G N>o. Let g be the greatest common divisor of c 
and n, and let f := | and n' := Since c' and n! are relatively prime there must 
exist a c" € N>ij such that c'c" =n> 1 - 

The following is true for all y,e G Z: cy =„ e iff y =n' c”^. □ 


Proof. Clearly, y =„/ c"| iff c'y =„< which, since dc" =n' 1, is equivalent to 
c'y =ni Furthermore, c'y =n' | iff there is a fc € Z such that c'y = n'k + | iff 
gc'y = gn'k + e iff cy = nk + e iff cy =„ e. ■ 

To denote a fraction of the form i (d+^J_j^ kjZj) with c, d, fci, .., e Z and c 0, 
we will write t{z) for short, and we will call such fractions generalized Sjixzsb-terms 
over the variables z. What we have just seen above is the following: 


5.3 Fact (5presb-Atoms). Let y and z = Zi,.., z,y he distinct first-order variables. 
For every 5presb-atom a{y,z) there is a generalized 5presb-term t{z) or a Cpresb- 
atom /3(z), in which the variable y does not occur, such that a{y, z) expresses over 
(Z, 5presb) that 


• 

y > 

{lower bound on y). 

• 

y < i{z) 

{upper bound on y). 

• 

y =n t{z) 

{residue class of y, for an appropriate n € N>o), 

• 

y = 

{equation for y), or 

• 

m 

{independent of y). 

On the other hand, it 

is straightforward to see that for any x e {>, <, 
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N>o} and any generalized ‘Presb-term t{z), the generalized atom y k t(z) can be ex¬ 
pressed by a quantifier free FO(*Presb)-formula. Similarly, for ix G {>, <, =}, also 
the generalized atoms y x and y k [f(£)J can be expressed by quantifier free 

FO(ipresb)-formulas. □ 


5.2 (Z, ^resb) and Unary Counting Quantifiers 

In this section we prove that Presburger’s quantifier elimination can be extended to 
unary counting quantifiers: 

5.4 Theorem (Elimination of Unary Counting Quantifiers). 

Every FOunC{^xtsb)-fonnula ip{z) is equivalent over (Z, (presb) to a formula of 
the form Vl^i j ('^) j where the aij are atoms built from the symbols in 

{=} U *Presb U {z}. □ 

In particular, this means that FOunC{<, -|-) = FO(<, -|-) on Z. 

The proof of Theorem will be given in a series of lemmas, the first (and most 
laborious to prove) is the following: 

5.5 Lemma. Every FOunC{'^xtsb)-formula of the form 3r^y A7=i -?) 7 where 

the aj are atoms built from the symbols in {=} U ^Presb U {y, z}, is equivalent over 
IfL, (Presb) to a FO(fPxe5b)-formula. □ 

Before proving Lemma |5.5| let us first look at an example that exposes all the relevant 
proof ideas. 

5.6 Example. Consider the formula z) := 

{z2+y < Z3+y+y) A {y < 22) A {y+y+y < zi) A {y+Z4 =4 Z3) . 

For interpretations x, zinZ of the variables x, z, this formula expresses that there are 
exactly x many different y € Z which satisfy the constraints 

(*) : y > Z 2 -Za, y < Z 2 , y < y 7 and y =4 z^-z^. 

--^^ ^^ ^^^ 

lower bound upper bound residue class 


We consider the integers low := Z 2 —Zs, up := min{ 2;27 [^]}7 and first, where 
first is the smallest integer > low which belongs to the correct residue class, i.e. which 
satisfies first =4 23 — 2 : 4 . The constraints (*) can be visualized as shown in Figure 
From Figure one can directly see that there are exactly max | 0 , "p- first | many 

different y G Z which satisfy the constraints (*). Hence, the statement “there are 
exactly x many y G Z which satisfy the constraints (*)” can be expressed by the 
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low first 


up 


Figure 1 ; Visualization of the constraints (>i=). The black points are those which belong to the 
correct residue class; the black points in the interval Ifirst, up) are exactly those integers y which 
satisfy the constraints (*). 


FO(ipresb)-fonnula tp{x,z) := 


3 low 3 up 3 first 

[low = Z2-Z3) A 

(up = Z2 W up = \^]) A (up ^ Z2) A (m/7 ^ 1 "^] ) A 

{first > low) A {first =4 23 — 2 : 4 ) A 

(Vu {v > low A V =4 23—24) ^ V first) A 

up-first \ 

4 ) ■ 


{up ifirst —> a;=0) A {up >first 


Altogether, we have constructed a FO(fpresb)-formula ijj{x,z) which is equivalent 
over (Z, *Presb) to the FOunC(^Presb)-formula ip{x, 2). □ 


Using the ideas presented in Example we are now ready for the formal proof of 
Lemma 5.5. 


Proof of Lemma 

Let (p{x,z) := 


__ y A?=i ctj{yt^) be the given formula, where the aj are atoms 

built from the symbols in {=} U 5presb U {y, 2}. Our aim is to construct a FO(5presb)- 
formula 'fi{x, 2) which is equivalent to (p{x, 2) over (Z, fpresb). 

The atoms ai,.., impose constraints on y. According to Lact 5.3 we can partition 
the set of atoms {cti,.., a„} into 


• a set F consisting of all atoms aj which express a lower bound of the form 

y > tjiz), 

• a set [/ consisting of all atoms aj which express an upper bound of the form 

y < tj{^’ 

• a set i? consisting of all atoms aj which express a residue class of the form 

y =n, A (A. 

• a set F consisting of all atoms aj which express an equation of the form y = 
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• a set / consisting of all atoms aj which are independent of y, i.e. which are 
equivalent over (Z, ipresb) to an atom /3j{z) in which the variable y does not 
occur. 

For interpretations tc, i'in Z of the variables x, z, the formula 

n 

:= 3='^y f\ aj{y,z) 
j=i 

expresses that there are exactly x many different y € Z which satisfy all the constraints 
(*) in L, U, R, E, and I. 

We first consider the easy case where E 

W.l.o.g. ai G E. This means that an y G Z which satisfies the constraints (*) must 
in particular satisfy the constraint y = Hence there is at most one y G Z 

(namely, y := ti{z)) that satisfies all the constraints (*); and the formula <p(x^ z) := 
Aj=i z) is equivalent to the FO(^Presb)-formula •= 

(a; = 0Va; = l) A = 

A ^i(^)>A(^) A ti{^<tj{z)A 

j:aj&L j-ajeU 

A ti{z) =nj tj{z) A A ^1(2) = A (A A /\ Pj{z)y 

j-.a^eR 3-aj^E j-oijel 


Let us now consider the case where E = %. 

First of all, we simplify the constraints in L, U, and i?: If L 7 ^ 0, the constraints in L 
can be replaced by the single constraint y > low, where the variable low is enforced to 
be interpreted by the maximum lower bound on y via the FO(ipresb)-formula 

ipiow{low,^ := \J low = ^ A l\ low ^ ■ 

j-.ocj^L J-ajeL 


Similarly, if U 7 ^ 0, we can replace the constraints in U with the single constraint 
y < up, where the variable up is enforced to be interpreted by the minimum upper 
bound on y via the FO(^Presb)-formula 

iljup{up,z} := (^ \J up = \tj{z)']'^ A A 

j:aj^U j'-ajGU 


W.l.o.g. we have i? 7 ^ 0. (We can assume that R contains, e.g., the constraint y =1 0 
which is satisfied by all y G Z.) 

We use the following fact to simplify the constraints in R. 

5.7 Fact. Let /c > 0, oi,.., Ofc G Z, ni,.., rifc G N>o, and let I := Icmjni, .. ,nk} be 
the least common multiple of ni,. ., 
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If there exists ar G {0,.., 1} such that (r ai A ■■■ A r afc) then, for all 

b G 1 j, we have 

[b =„^ ai A • • • A 6 afc) ijf b=ir . 

If no such r exists, then no b G h satisfies (b Oi A ■■■ A b Ofc). □ 

Proof. Let us first consider the case where there exists are {1,.., 1} such that 

(r ai A • • • A r =n^ Ofc). It is obvious that (6 =ni oi A ■■■ A b =„^ Uk) if 
and only if (b r A ■■■ A b r) if and only if (rii \ b—r A ■■■ A Uk \ b—r^ 
if and only if lcm{ni,.., rifc} | b—r if and only if b =/ r. 

For the second claim of the above fact we prove the contraposition. I.e. we assume 
that there is some b G Z with (h ai A • • • A 6 Ofc), and we show that an 
appropriate r does exist. In fact, let r e {0,.., 1} be the residue class of b modulo I, 

i.e. r =i b. Since I = Icmjni,.., rifc}, we know that rij \ I, and hence r b =n- aj, 
for every j G {1,, k}. ■ 


The above fact tells us that we can replace the constraints in R by the single constraint 
y =i res, where I := lcm{nj : j such that aj G R}, and where the interpretation of 
the variable res is determined by the FO(^resb)-formula 


iljres{res,z) := ( 0 res < M ) A res=n^tj{z). 

j-.ajGR 


As already done in Example p.q , we consider a variable first which is interpreted by 
the smallest integer > low that belongs to the correct residue class, i.e. that satisfies 
first =i res. This interpretation of the waiiable first can be enforced by the FO(^Presb)- 
formula 


f’firstifirst, low, res) 


:= (first > low) A (first =i res') A 

(fiv (v > low A V =i res) v first) . 


The constraints in LU U U R can be visualized as shown in Figure H from which 


we 


up—first 
I 


I many different y G Z 


can directly see that there are exactly max | 0 
which satisfy all the constraints in F U F U i?, provided that res exists and that L and U 
are nonempty. If res exists and L or F are empty, then there are infinitely many y GZ 
which satisfy all the constraints in F U F U F. If res does not exist, then no y G Z 
satisfies these constraints. 

Remember that the given formula ip(x,z) := Aj=i have, 

apart from the constraints in F U F U F, also constraints from I which are independent 
of y. (However, we assume that there are no equations, i.e., that E = 0.) Altogether 
we obtain that y>(x, z) is equivalent to the FO(ipresb)-formula ip{x, z) := 


((^^ ^ ((A ^ 

j:aj£l j-.ocjGl 

(( -:3res fresfies, z)) —> x=0 ) A (( 3res ip,^fires, z)) —» x (®5 f res )) j 
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where x is defined as follows: If L or 17 are empty, then x(x, z, res) := -^x=x. If L 
and U are nonempty, then x(a:, 7*, res) := 


3 low 3 up 3 first 

'fiiow{low,z) A iiup{up,z) A iifirst(first,low,res) A 


(wp ^ first —!■ x=0) A (up > first 
This completes the proof of Lemma |5.5|. 


up—first 
I 


From Lemma |5.5| we know how to eliminate the counting quantifier from a formula 
of the form 3^^y 0(p, z), where 0 is a conjunction of ^Presb-atoms. The following 
lemma lifts the elimination of the counting quantifier to be valid also for formulas 
where 0 is a disjunction of conjunctions of atoms. 


5.8 Lemma. Every FOunC{^xe5b)-formula of the form 3=“p Vti Ajli •^) i 

where the atj are atoms built from the symbols in {=} U ipresb U {p, z}, is equivalent 
over (Z, ^Presb) to a FO{^xzsb)-formula. □ 


Proof. The proof makes use of Lemma 5.5 and of the w ell-know n principle of inclusion 
and exclusion {P.I.E. for short; cf., e.g., the textbook [Cam94]): 


5.9 Fact (P.I.E.). Let m > 0 and let Ci,.., Cm be sets. The following is true: 

m 

iQc.i = ^ (-1)17-1.1 Pic,! 

j=l 07 '/C{l,. . ,m} ie/ 


□ 


We now concentrate on the proof of Lemma |5.8[ 

Let 3=^y VlLi Ci{y,z) be the given formula, where Ci{y,z) := aij(^y,z). 
Let X, z he interpretations in Z of the variables x, z. We write Ci{-, z) to denote the 
set of all y € Z for which the conjunction Ci{y, z) is satisfied when interpreting p, z 
by y, z. Obviously, we have 


(Z,*Ptcsb,a:,z) (= 3 \/Ci{y, z) 

i=l 

iff 

m 

i=l 07 ^/C{l,. . ,m} iGl 

For every set I we introduce a new variable xj with the intended meaning that xj = 
I riig/ Cii'i ^)l’ which can be enforced by the formula 3=“ip /\^^pCi{y, z). This 
leads to the fact that 


X = ^ ■ I n C'i(-! 2 )l 

I iGl 

iff 

(Z,q3resb,a;,z) A (* = ^ V /\Ci{y,z)) . 

I I ZGI 
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Since f\-^j Ci{y, z) = f\^^j Ajii aij{y, z) , we can apply Lemma to replace 
each subformula 3^^‘y /\^^JCi{y, z) by a FO(ipresb)-formula ipi{xi,z). 

Altogether, we obtain a FO(‘Presb)-formula '(/'(a;, z) which is equivalent over (Z, ipresb) 
to 3^^y Vfci Ci{y, z). This completes the proof of Lemma ■ 


The result of Theorem 5.4, stating that Presburger’s quantifier elimination can be ex¬ 
tended to unary counting quantifiers, now is an easy consequence of Lemma 5.8 and 


Theorem 5.1 


Proof of Theorem |5.4| . 

According to Presburger’s quantifier elimination (Theorem ^t| ) it suffices to show 
that every FOunC(?Presb)-formula (p is equivalent over (Z,*Presb) to a FO(5presb)- 
formula -ip. We proceed by induction on the construction of (p. The only nontrivial case 
is when (p is of the form xiV: -?)■ By the induction hypothesis x is equivalent 

to a formula of the form Vl^i Aj=i L)’ where the are atoms built from 


the symbols in {=} U Cpresb U {y, z}. Thus, from Lemma 5.8 we obtain the desired 
FO(5presb)-formula 'ip{x, z) which is equivalent to (p{x, z) over (Z, 5presb). ■ 


5.3 From (Z, ^resb) to (M, ^rcsb) 

It is straightforward to transfer Theorem from Z to N to obtain 
FOuiiC(<,-|-) = FO(<,-b) onN. 


Precisely, this means: 

5.10 Corollary. Every FOunC{^xzsb)-fonnula ip{z) is equivalent over (N, ipresb) to 
a formula of the form VI^i AJ=i i where the aij are atoms built from the 

iym/7oF in {=} U Cpresb U {z}. □ 

Proof. We make use of Theorem and of the following relativization of quantifiers 
which gives us, for every FOunC(ipresb)-formula ip{z), a FOunC(?Presb)-formula 
ip{z) such that the following is valid for every interpretation z G N of the variables z 

(*) : (N,5presb, z) ^ (p(z) iff (Z, ipresb, z) |= (^(z). 


The formula f is defined inductively via 


• ip := tp if is atomic, 

• (p := -ipj if If = -itp, 

• <p:= fy X if F = AVx. 

• (p ■.= 3y (py ^ Q /\ Ip) if p = 3y ip, and 

• (p := 3^^y (y ^ 0 A A) if ‘P = 3^^y ip. 


It is straightforward to see that (*) is indeed true. 

According to Theorem ^ , the formula ip{z) is equivalent over (Z, 5presb) to a formula 
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of the form Vti Aj=i ctij (A) > where the aij are *Presb-atoms. It is obvious that, 
whenever the variables z are interpreted by non-negative integers z G N, it makes no 
difference whether the atom aij{z) is evaluated in the structure (Z, Cpresfa) or in the 
structure (N, Cpresb). We thus obtain for every interpretation ;? S N of the variables z 
that 



(N,‘llresb, £) 

h 

ip{z) 

iff 

(Z, Cpresb, z) 

h 

<f(z) 

iff 

(Z,'Presb,£) 

h 


iff 

(N,'Presb,£) 

h 

yT=lA;u^^AA 


I.e., the FOunC(^resb)-formula (p{z) is equivalent over (N, *Presb) to the quantifier 
free formula VAi A’jLi • 


5.4 From (Z, ^resb) to Initial Segments of N 

Let us now investigate the finite versions of Presburger arithmetic, where the universe 
is some initial segment of N. I.e., for every N G N>o we want to consider the substruc¬ 
ture of (N, ipresb) with universe JV := {0,.., N}. 

There is some technical difficulty since JV is not closed under the addition function 
/+. We therefore move over to the version Cpresb^ of Presburger arithmetic without 
function symbols. I.e., *Presb^ := {0, 1, i?+ , <, (=„)„gN>o }, where i?+ denotes 
the ternary addition relation (which, in this paper, is usually simply denoted -f). 

Now, the initial segment (JV, ^Presb^) of Presburger arithmetic is defined in the canoni¬ 
cal way, i.e., i?+ is interpreted by the set of all triples (a, b, c) G for which a+b = c. 
The aim of this section is to show that 


FOunC{<, +) = FO{<, +) on initial segments of N. 


Precisely, this means; 

5.11 Corollary. Every FOunC{^xzsb')-formula ip(z) is equivalent over the class 
{(^j^Presb') : TV e N>o} to a FO(‘^xesb')-formula il^(z). □ 


Here, the formula ijj cannot be taken quantifier free in general, because the addition is 
not present as a function (allowing to express summations of more that just two vari¬ 
ables), but only as a relation. 


Proof of Corollary |5.1l| . 

The proof is similar to the proof of Corollary 5.10 . However, the fact that the uni¬ 
verse is finite and that the addition is only present as a relation, causes some technical 
problems. We make use of Theorem 5.4 and an appropriate relativization of quanti¬ 
fiers: We introduce a new variable max with the intended meaning that max denotes 
the maximum element N in the underlying finite universe; and we transform a given 
FOunC(*Presb^)-formula ip(z) into an appropriate FOunC(^Presb)-formula if(z, max) 
such that the following is valid for every N G N>o and for every interpretation z G N 
of the variables z 


(*) • (A .1 ^5resb', 2 ) 1= iff {Ij,'^xz5b,z,N) \= (p{z,max). 
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The formula (p is defined inductively via 


• '■= f+{x,y) = Z if (p = R+{x,y,z), 

• (p := p if (/j is an atom not involving the addition relation i?+, 

• ip := -i'0 if p = -itp, 

• <p:= ijjW X if p = ipV 

• p := 3y (O ^ y ^ max /\ tp) if p = 3y p), and 

• p ■= 3^^y (O ^ y ^ max A tp) \f p = 3^^y ip. 


It is straightforward to see that (*) is indeed true. 

According to Theorem 5.4, the formula p{z,max) is equivalent over (Z,*Presfa) to a 
formula of the form Vi=i Ajii '^i,j (A max), where the aij are atoms built from the 
symbols in {=} U 5presb U {i*, max}. 

Of course, it suffices to show that each such ^}5resb-atom can be transformed into a 
FO(5presb^)-formula max) such that the following is valid for every N G N>o 

and for every interpretation 5“ e of the variables z 

{**) : (Zj^xcsb, z, N) \= aij{z, max) iff {N_,^vesb', z, N) \= Xi,j{z,max). 


To see what is the problem about defining Xi.j, let us have a closer look at the ^}?resb- 
atom aij. By definition, the atom aij expresses that 


(***): ui + - \- Uk K VI + ---+VI 


where k,l G N, k is an element in {=, : n G N>o}, and ui,.., Uk, vi,.. ,vi 

are (not necessarily distinct) elements in {0,1, z, max}. 

When the variable max is interpreted by some N G N>o and the variables z are inter¬ 
preted by numbers z € TV, then the term ui + ■ ■ ■ + Uk evaluates to a number of size 
at most k ■ N. But there is no guarantee that this number does not exceed TV, i.e. that 
it belongs to the underlying finite universe TV. We therefore have to move over to the 
2-tuple version which allows us to represent a number x of size at most iV^ (> k-N, 
for N large enough) by two numbers xi,xo in TV via x = a;i-(TV-|-l) -f xq. From 
Theorem 3.4 we know that there is a FO(i?+)-formula p^ which expresses the addi¬ 
tion relation for numbers that are represented by such 2-tuples. Hence, the result of 

(k) (k)\ 

the summation ui + ■ ■ ■ + Uk is the number represented by the 2-tuple (uf ,Mg ), 
where , u^'^) is determined by the FO(F+)-formula 






0 A Uq—ui a ‘^+(^1 


(i-i) 


r\ (0 


In the same way one obtains a 2-tuple (tif^, Vq'^) which represents the result of the 
summation vi + ■ ■ ■ + vi. Finally, making use of the formulas p\ and p%^ from 
Theorem [3.4[ (***) can be replaced by 

• if K is = 
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‘P<[ 


'-1 J “0 I ‘^1 ) '^0 


)) if 


K IS < 


{ui , Uq , , Vq) if K is a congruence relation =„. 


Altogether we obtain a FO(^Presb')-formula Xi,j that has property (**). This com¬ 
pletes the proof of Corollary 5.1 1|. ■ 


6 Applications 

In this section we point out some applications of the previous section’s result that 
FOunC{<,+) = FO{<,+) on N and on initial segments of N. We obtain the failure of 
a particular version of the Crane Beach conjecture, and we show that reachability and 
connectivity of finite graphs are not expressible in first-order logic with unary counting 
and addition. 


6.1 Reachability 

A finite graph G = (V, E) consists of a finite set V of vertices and a set F C of 
directed edges. A directed path p = {vo, ■ ■ ,Vk) of length fc is a sequence of vertices 
satisfying E{vi,Vi+i) for all i G {0,.., k—1}. We say that p is a path from s to f if 
s = Vo and t = Vk- The path p is called deterministic if, for each i G {0,.., k—1}, 
the edge {vi,Vi+i) is the unique edge in G leaving vertex Vi, i.e., there is no vertex 
u 7^ Vi+i in V such that E{vi,u). 

6.1 Definition (Det-Reach). 

Deterministic Reachability, Det-Reach, is the set of all finite graphs G, together with 
a distinguished source vertex s and a distinguished target vertex t, such that there is a 
deterministic path from s to t in G. I.e., 


Det-Reach 


{G,s,t) 


G = {V, E) is a finite graph, s,t G V, and 
there is a deterministic path from s to t in G 


□ 


The problem Det -Reach is complete for LOGSPACE via first-order reductions (cf., 
e.g., the textbook [ lmm99i Theorem 3.23]). An important open question in complexity 
theory is to separate LOGSPACE from other, potentially weaker, complexity classes. 
Such a separation could be achieved by showing that the problem Det-Reach does 
not belong to the potentially weaker class. One potentially weaker class for which 
no separation from LOGSPACE is known by nowQ is the class TC° that consists of 
all problems solvable with uniform threshold circuits of polynomial size and constant 
depth. As already mentioned in Section 4.3, it was shown in [BIS90| that, for ordered 
structures over arbitrary signatures r, logtime-uniform TC° is exactly the class of all 
problems definable in EOunC{+, x, r). To separate TC° from LOGSPACE it would 
therefore suffice to show that Det-Reach is not definable in EOunC(+, x, E,s, t). 
Ruhl [Ruh99| achieved a first step towards such a separation by showing the (weaker) 
result that Det-Reach is not definable in EOunC(+, E, s, t). Precisely, this means: 

'^TCfi has not even been separated from NP, cf., [ \1196|. 
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6.2 Theorem (Ruhl [Ruh99|). There is no FOunC{+ E, s, t)-sentence ip such that, 
for every N G N>o and all graphs G = E) with vertex set Nj and vertices s,t G 
Nj we have {G, s, t) G Det-Reach ijf (iV, +, E, s, t) \= fi. □ 


The aim of this section is to point out that Ruhl’s theorem can be proved easily when 
making use of our result that FOunC{+) = f^O(+) on initial segments of N. Before 
presenting the easy proof, let us first outline Ruhl’s approach: 

Ruhl’s proof method is the Ehrenfeucht-Fraisse game for FOunC{+, E). He con¬ 
siders, for each N G N>o and R G N_ the graph Gr^n = {Ki Er^n) where the edge 
relation Er^n is defined via “Er n{u, v) iff u + R = v”, for all vertices u.v G N. 
An illustration of the graph jv is given in Figure 



Figure 2: Visualization of the graph Gr,n (for R = 3 and N — 15). There is an edge from a 
vertex u to a vertex v iff u + R = v. 


Note that the graph Gr^n is constructed in such a way that i? | TV if and only if there 
is a deterministic path from 0 to N, i.e. {Gr^n, 0, TV) G Det-Reach. 

For every fixed number M of rounds in the Ehrenfeucht-Fraisse game, Ruhl constructs 
an Nm G N>o and an Rm G Nm such that Rm \ Nm and 2Rm \ Nm- After¬ 
wards he explicitly exposes a clever and very intricate winning strategy for the duplica¬ 
tor in the TV/-round Ehrenfeucht-Fraisse game for FOunC{+, E, s, t) on the structures 
(Gfl„,ArM,0,TVM) and {G 2 Rm,Nm^^^^m)- He thus obtains, for every M, that the 
structures {Gr^,Nm,0, Nm) G Det-Reach and {G2Rm,Nm,0, Nm) ^ Det-Reach 
cannot be distinguished by FOunC{+, E, s, f)-formulas of quantifier depth M. Alto¬ 
gether, this shows that Det-Reach is not definable in FOunC{+, E, s, t). 

As usual in Ehrenfeucht-Fraisse arguments, precise bookkeeping is necessary for 
the proof. This bookkeeping can be avoided when using Presburger’s quantifier elimi¬ 
nation and its extension to unary quantifiers: 

Proof of Theorem |^ . By contradiction. 

Suppose that ^ is a FOunC(+, E, s, i)-sentence defining Det-Reach. 

The first step of the proof is to transform ip into a FOunC(-|-)-formula (pi (x) which 
expresses that R | TV, whenever the variable x is interpreted by a number R in an 
underlying universe TV. For this tranformation we make use of Ruhl’s graphs Gr^n 
from which we know that {Gr,n,0, N) G Det-Reach if and only if i? | TV. The 
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formula <fi{x) is obtained from ij) by replacing every atom E{u,v) with the atom 
u + X = V, hy replacing s with 0, and by replacing t with max. Here, a; is a variable 
not occurring in ijj, and max is a variable that is enforced to be interpreted with the 
maximum element in the underlying universe. Of course we have for all N G N>o and 
all i? G iV that 


R\N iff (G_R,Ar,0, iV) € Det-ReACH 
iff (iV, +, 0, TV) 1= Ip 

iff {N,+,R) ^ ip.ix). 


This completes the first step of the proof. 

From Corollary 5.1l| we know that the counting quantifiers can be eliminated from 
(pi{x). I.e., we obtain a FO(+)-formula ip 2 ix) which expresses that R \ N whenever 
the variable x is interpreted by a number R in an underlying universe This gives us 
a FO(+)-sentence (ps := Va: <p 2 {x) (a:=l V x=max) which expresses that is a 

prime number. In other words: ip^ is a FO(+)-sentence whose spectrum is the set of 
prime numbers. This is a contradiction to the Theorem of Ginsburg and Spanier (cf., 
Section 3.2) and completes the proof of Theorem |6.2[ ■ 


6.2 Connectivity 


6.3 Definition (CONN). Connectivity, Conn, is the set of all finite graphs G which 
are connected, i.e., where there is a path from u to v, for all vertices u f v in G. □ 


Note that Theorem 5.2 in particular implies that the general reachability problem Reach 
(which is defined in the same way as Det-Reach except for replacing “deterministic 
path” with “path”) is not definable in FOunC(+, E, s, t). When considering a logic that 
is closed under universal quantification, then CONN is definable as soon as Reach is, 
via 'i/'CoNN := Va; Vy ^^reach (a;, y), where v^reach is a formula defining Reach. How¬ 
ever, Mndefinability of CONN does not a priori follow from undefinability of Reach. 
Nevertheless, a variation of the proof of Theorem |6.2| leads to the result that also CONN 
is not definable in FOunC(+, E). More precisely: 


6.4 Theorem. There is no FOunC{+, Efsentence ip such that, for every N € N>o 
and all graphs G = (TV, E), we have (TV, E) € CONN iff (TV, +, E) \= ip. □ 


Proof. By contradiction. 

Suppose that i/) is a FOunC{+, F)-sentence defining CONN. Again, we transform ip 
into a FOunC(+)-formula pi{x) which expresses that R \ TV, whenever the variable x 
is interpreted by a number R in an underlying universe TV. Instead of the graphs Gr^n 
we now consider the graphs Hr^n illustrated and defined in Figure |[ 

It is straightforward to see that EIr^m is connected if and only if i? | TV. 

The formula pi(x) is obtained from ip by replacing every atom E{u, v) with the for¬ 
mula xiu, v) V xift, u), where 


x{u,v) := u+x=v V (u=l A v=max) V (0<u, A u+l=v A v<x). 


Here, a; is a variable not occurring in ip, and max is a variable that is enforced to be 
interpreted with the maximum element in the underlying universe. For all TV G N>o 
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Figure 3; Visualization of the graph Hr^n (for R = 3 and N = 15). There is an edge between 
vertices u and u iff {u+R=v) V (u=l A v=N) V (0<w A u+l=v A v<R). 


and all R € ^ we have i? | iV iff (iFij,Ar,+) |= ip iff (iY_, +,i?) |= tfiiix). The rest 
can be taken verbatim from the proof of Theorem ■ 


6.3 A Specific Case of the Crane Beach Conjecture 


The Crane Beach conjecture deals with logical definablility of neutral letter languages. 
A language L (i.e., a set of finite strings) over an alphabet A is said to have a neutral 
letter e S A if inserting or deleting e’s from any string over A does not change the 
string’s membership or non-membership in L. Given a logic F and a class 21 of arith¬ 
metic predicates, the Crane Beach conjecture is said to be true for F(<, 21) iff for every 
finite alphabet A and every neutral letter language L over A the following is true: If L 
is definable in F'(<, 21) then L is already definable in F(<). 

The Crane Beach conjecture is closely related to uniformity conditions in circuit 
complexity theory and to collapse results in database theory. Depending on the logic 
F and the predicates 21, the Crane Beach conjecture turns out to be true for some cases 
and false for others. A detailed investigation and a state-of-the-art overview of what is 
known about the Crane Beach conjecture can be found in [BILST|. Using the result of 
Corollary 5.1C that FOunC{<, -f) = FO(<, -f) on N, one can prove the conjecture to 
be false for the following specific case: 


6.5 Theorem ([ |BILST| , Theorem 6.4 (h)]). 

Let P C N be a set that is not semi-linear^ The Crane Beach conjecture is false for 
FOunC(<, P). More precisely: There is a neutral letter language L over the alphabet 
{a, e} that can be defined in FOunC{<, P), but not in FOunC{<). □ 


Proof (Sketch). Choose L to be the set of all strings w over {a, e} where the number of 
a’s in w belongs to P. Now assume, for the sake of contradiction, that L is definable by 
a FOunC(<)-sentence x- I-s., for every string w over {a, e} we assume that w satisfies 
X iff tu C L. It is not difficult to translate x into a FOunC(<)-formula (p{x) such that 

set P C N is semi-linear iff there are p, No G N such that for every N > No we have At G P iff 
N-i-p G P. 


31 









P = {N e N : (N, <) ^ ip{N)}. However, due to Corollary 5.10, ip(x} is equivalent 
over N to a FO(<, +)-formula ip{x). From the Theorem of Ginsburg and Spanier we 
therefore obtain that P is semi-linear, which is a contradiction to the choice of P. ■ 


7 Conclusion and Open Questions 

In this paper we have gained a complete picture of the expressive power of hrst-order 
logic with counting quantihers and arithmetic. This picture if visualized in the follow¬ 
ing Figures ^ and g. Concerning these diagrams, the only question that remains open 
is whet her F OunC(+, x) = FO(-|-, x) on initial segments of N. As pointed out in 
Section |3.4| , inequality would imply LINH ^ ETIME, whereas no such complexity 
theoretic consequence is known for the case of equality. 

A main theorem of this paper is that Presburger arithmetic is closed under unary 
counting quantihers. As applications of this we obtained an easy proof of Ruhl’s re¬ 
sult that deterministic reachabiliy in hnite graphs is not dehnable in EOunC{+), that 
connectivity of hnite graphs is not dehnable in EOunC{+), and that the Crane Beach 
conjecture is false for EOunC{<, P) whenever F is a set of natural numbers that is not 
semi-linear. 


FOk-aiyC{<) = FOk-aryC{+) 


FOk-aryC{+, x) (V ^ 2) 


II [BIS90] 


FOunC{<) 


FOunC{+) ™''" 


FOunC{+, x) 


I 

I 

I 


FO{+, x) 


□i 

FO(+) 


FO«) 


□ 


Figure 4: Expressive power for pure arithmetic. Lines indicate proper inclusions. For N the 
dashed line can be replaced by equality (cf.. Proposition For initial segments of N this 
remains open; however, as pointed out in Section 3.4, inequality would imply LINH 7 ^ ETIME. 


With regard to the questions here, we want to mention the following interesting prob¬ 
lems: 
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□ 



Is there any serious complexity theoretic consequence for the case that FOunC{+, x) 
= FO(+, X) on initial segments of N? 


The author thinks it would be fruitful to translate the tools developed for bounded 
arithmetic (cf., | EM981) into the language used for descriptive complexity and circuit 
complexity, i.e., into results about FO(+, x) on initial segments of N and on finite 
structures. 


It is an important task to search for inexpressibility results for FOunC(+, x ) on finite 
structures. Since FOunC(+, x) corresponds to the complexity class TC°, an inex¬ 
pressibility result would give us a separation of complexity classes. This indicates 
that this task will be very hard to attack. 


More tractable seems the investigation of the hne structure of first- order l ogic with 
majority quantifiers. As mentioned in Section O, it was shown in [BIS90] that 


FObinM{<) = FOunM{+, x) = FOuiiC(-|-, x) ^ TC^ 
on finite structures. 


In [ |LMSV01| ] it was shown that FOunM{<) C FObinM{<). It is not difficult to see 
that FO(<) C FOunM{<): The FOunM(<)-formula 3x[My {y ^ x) A My (y ^ 
a;)) expresses that the cardinality of the underlying universe is odd, whereas this is 
not expressible in FO(<) (cf., e.g., the textbook [ EF99| , Example 2.3.6]). 

It remains open whether on finite structures we have 


FOunM{<) = FOunM{<,+) = FOunC{<,+). 


























References 


[AB84] Miklos Ajtai and Michael Ben-Or. A theorem on probabilistic constant 
depth computations. In STOC’84: 16th Annual ACM Symposium on the 
Theory of Computing, pages 471^74, Washington, D.C., 1984. 

[Ajt83] Miklos Ajtai. Sj-formulae on finite structures. Annals of Pure and Ap¬ 
plied Logic, 24:1^8, 1983. 

[AK99] Albert Atserias and Phokion G. Kolaitis. First-order logic vs. fixed-point 
logic in finite set theory. In LICS’99: 14th Annual IEEE Symposium on 
Logic in Computer Science, pages 275-284, Trento, Italy, July 1999. IEEE 
Computer Society. 

[A1196] Eric Allender. Circuit complexity before the dawn of the new millenium. 

In V. Chandru and V. Vinay, editors, FSTTCS’96: 16th Conference on 
Foundations of Software Technology and Theoretical Computer Science, 
volume 1180 of Lecture Notes in Computer Science, pages 1-18, Hyder¬ 
abad, India, December 1996. Springer. 

[Ats99] Albert Atserias. Computational aspects of first-order logic on finite struc¬ 
tures. Master’s thesis. University of California, Santa Cruz, Department 
of Computer Science, March 1999. 

[Ben62] J. H. Bennet. On Spectra. PhD thesis, Princeton University, Princeton, 
NJ, 1962. 

[Bes02] Alexis Bes. A survey of arithmetical definability. In A tribute to Maurice 
Bojfa, pages 1-54. Soc. Math. Belgique, 2002. Available at http: // 
WWW.univ-parisl2.fr/lacl/bes/publications.html. 

[BILST] David A. Mix Barrington, Neil Immerman, Clemens Lautemann, 
Nicole Schweikardt, and Denis Therien. Eirst-order expressibil- 
ity of languages with neutral letters or: the Crane Beach conjec¬ 
ture. Available at http://www.informatik.uni-mainz.de/ 
'nisch/publications .html. Revised version of: The Crane 
Beach conjecture, LICS’Ol: 16th Annual IEEE Symposium on Logic in 
Computer Science, Boston, Massachusetts, USA, June 2001, pages 187- 
196. 

[BIS90] David A. Mix Barrington, Neil Immerman, and Howard Straubing. On 
uniformity within NC^. Journal of Computer and Systems Sciences, 
41:274-306, 1990. 

[BK97] Michael Benedikt and H. Jerome Keisler. The expressive power of unary 
counters. In Eoto N. Afrati and Phokion Kolaitis, editors, ICDT’97: 6th 
International Conference on Database Theory, volume 1186 of Lecture 
Notes in Computer Science, pages 291-305. Springer, 1997. 


34 


[Cam94] Peter J. Cameron. Combinatorics. Cambridge University Press, Cam¬ 
bridge, 1994. 

[DDLW98] Anui Dawar, Kees Doets, Steven Lindell, and Scott Weinstein. Elementary 
properties of finite ranks. Mathematical Logic Quarterly, 44:349-353, 


[DGS86] 

1998. 

Larry Denenberg, Yuri Gurevich, and Saharon Shelah. Definability 
by constant-depth polynomial size circuits. Information and Control, 
70:216-240, 1986. 

[DLM98] 

Arnaud Durand, Clemens Lautemann, and Malika More. Counting results 
in weak formalisms. Technical Report 1998-14, Universite de Caen, 1998. 

[EF99] 

Heinz-Dieter Ebbinghaus and Jorg Hum. Finite model theory. Springer, 
New York, second edition, 1999. 

[EM98] 

Henri-Alex Esbelin and Malika More. Rudimentary relations and primi¬ 
tive recursion: A toolbox. Theoretical Computer Science, 193:129-148, 
1998. 

[Ete97] 

Kousha Etessami. Counting quantifiers, successor relations, and logarith¬ 
mic space. Journal of Computer and Systems Sciences, 54(3):400^11, 
June 1997. Special issue for the 10th IEEE Structure in Complexity The¬ 
ory Conference, 1995. 

[FKPS85] 

Ronald Fagin, Maria M. Klawe, Nicholas J. Pippenger, and Larry Stock- 
meyer. Bounded depth, polynomial size circuits for symmetric functions. 
Theoretical Computer Science, 36:239-250,1985. 

[FSS84] 

Merrick L. Furst, James B. Saxe, and Michael Sipser. Parity, circuits, and 
the polynomial-time hierarchy. Mathematical Systems Theory, 17:13-27, 
1984. 

[Har73] 

Keith Harrow. Sub-elementary classes of functions and relations. PhD 
thesis. New York University, Department of Mathematics, 1973. 

[Imm99] 

Neil Immerman. Descriptive complexity. Springer, New York, 1999. 

[KorOl] 

Ivan Korec. A list of arithmetical structures complete with respect to 
the first-order definability. Theoretical Computer Science, 257:115-151, 
April 2001. 

[Lin95] 

Steven Lindell. How to define exponentiation from addition and multipli¬ 
cation in first-order logic on finite structures. Email note, available from 


slindell@haverford.edu, 1995. 

[LMSVOl] Clemens Lautemann, Pierre McKenzie, Thomas Schwentick, and Heribert 
Vollmer. The descriptive complexity approach to LOGCFL. Journal of 
Computer and Systems Sciences, 62:629-652, 2001. 


35 



[Lyn82] James F. Lynch. Complexity classes and theories of finite models. Math¬ 
ematical Systems Theory, 15:127-144, 1982. 

[Pre30] M. Presburger. Uber die Vollstandigkeit eines gewissen Systems der 
Arithmetik ganzer Zahlen in welchem die Addition als einzige Opera¬ 
tion hervortritt. Comptes Rendiis I Congres des Mathematiciens des Pays 
Slaves, Warsaw, 1930. 

[Pug94] William Pugh. Counting solutions to Presburger formulas: How and why. 

In PLDr94: Annual ACM SIGPLAN Conference on Programming Lan¬ 
guage Design and Implementation, SIGPLAN Notices 29(6), pages 121- 
134, Orlando, Florida, USA, June 1994. 

[PW86] Jeff Paris and Alex Wilkie. Counting Aq sets. Fundamenta Mathematicae, 
127:67-76, 1986. 

[Ros94] Harvey E. Rose. A course in number theory. Oxford University Press, 
second edition, 1994. 

[Ruh99] Matthias Ruhl. Counting and addition cannot express deterministic tran¬ 
sitive closure. In LICS’99: 14th Annual IEEE Symposium on Logic in 
Computer Science, IEEE Computer Society, pages 326-334, Trento, Italy, 
July 1999. 

[SchOl] Nicole Schweikardt. On the Expressive Power of First-Order Logic with 
Built-In Predicates. PhD thesis, Johannes Gutenberg-Universitat Mainz, 
Eachbereich Mathematik und Informatik, December 2001. Published at 
Logos-Verlag, Berlin, 2002, ISBN 3-8325-0017-0. 

[Smo91] Craig Smoryriski. Logical number theory I. Springer, 1991. 


Appendix 


Proof of Theorem [3.4| . 

Eor a tuple x := {xd- 


1 ) 


.jXo) C {NY we write #jv(a;) to denote the number 


(a): Obviously, the formulas can be inductively defined via 

<fi<(xo,yo) '■= xo<yo, and, for all d^l, 
‘P'<'^(xd,..,xo,yd,..,yo) ■■= xd<yd V (xd=yd A ipi(xd-i, ■ ■ ,xo,yd-i, ■. ,yo)) ■ 


( b ): We first concentrate on d=l. Eor xq, yo, 21,2:0 G N_:= {0,.., N}, the formula 
¥^+(a:o, 2 / 0 , 2 i, 20 ) shall express that xo + ?/o = 2 i-(A-|-l)-f 20 . 

If xo + 2/0 ^ N, then xq + 2/0 = 2i-(A-|-l) -f 20 iff 21 = 0 and 20 = xq + yo- 
Otherwise, we have N-\-l ^ xq -f 2/0 < 2 -(iV-l-l), and hence there are u,v G N_ such 
that xo + It = A and u 4- v = yo — 1 . Thus xo+2/0 = xo+'u-|-l-|-u = (A-fl) -f v. 
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Hence, xq + ?/o = 2i-(-/V+l) + zq iff zi = 1 and Zq = v. 

This can easily be expressed in FO(+). 

For d ^ 1 the formula can be defined by induction: Obviously, 

#N{Xd,Xd-l,..,Xo) + #N{yd,yd-l,--,yo) = #N{Zd+l,Zd,Zd-l,..,Zo) 

if and only if 

there is a carry c G {0,1} such that 
#N{xd-l, ■ ■ ,Xo) + #N{yd-l, ■ ■ ,yo) = #N{c,Zd-l,--,Zo) 
and c + Xd + yd = Zd+i-{N+l) + Zd ■ 

The formula can now be easily defined in FO(+) by using the formulas (p'^ and 
F+- 

(c): By definition we have for arbitrary numbers x,y G N that x =„ y iff there is 
some z S {0,.., max(a:, y)} such that x = y + n-z or y = x + n-z. Since n is fixed, 
n-z can be expressed by the n-fold sum z + ■ ■ ■ + z. When considering d-tuples repre¬ 
senting the numbers x, y, then z can be represented by a d-tuple, too. By applying (b), 
the n-fold sum of those d-tuples can be expressed in FO(-f). This gives us the desired 
formula . 


Since the proof of part fdj is a bit lengthy, let us first concentrate on 


(e): For y G and x := {xd-i, ■ ■, xo) G {N_Y formula y) shall express 

that the y-th bit in the binary representation of ^n{x) is 1. 

Because of := ^*(-^+1)* < (A^+1)'^, the y-th bit of #jv(S’) can be 

1 only if y < d • lg(A^+l). For y < d ■ lg(iV+l) let y = yi + ■ ■ ■ + yd where 
yt < lg(A^+l), and let Zi := 2^' G ^ for i G {1, • ■, d}. The j/-th Bit of #Ar(i;) is 1 


iff 


#n{x) 


Because of 

yi,--,yd,zi 

and there are ul, 


#n{x) 
2yi ■■■2yd 

LfJ 


I _ #n{x) I J 


is odd. 


= we hence obtain that the y-th Bit of ^^{x) is 1 iff there are 

Zd G iVsuchthaty = yi-\-- ■ -G-yd, andzi = 2^' foralH G {1,.. ,d}, 
G ^ for all i G {0,.., d} such that .., Ug) = 

for all i G {0,.., d—1}, 


■ ,'^q) 

Zi + l 


.. ,a;o), and = 

and .. ,no) is odd. 

Making use of Theorem [3 . 2| and of parts (a),(b), and (d) of Theorem 3.4, this can easily 
be expressed by a FO(Bft)-formula (pg^- 


(d): The proof is by induction on d. In Step 1 we prove the induction step from d to 
d+1, and in Step 2 we concentrate the induction start for d = 1. 

Step 1: Let d ^ 1, and assume that the formulas p\ and are already available. Our 
aim is to construct the formula 

To expose the overall idea, we consider the multiplication of two decimal numbers. For 
example, 5731 x 2293 = (5000 + 731) x (2000 -f 293) = 

(5000 X 2000) -f (5000 x 293) + (731 x 2000) -f (731 x 293). 
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In the same way for numbers x,y € it obviously holds that 


4i^N i^d, ^d—1, • 

■ ,xo) X #N{yd,yd-i 

( #7v(a:d,0,.. ,0) 

+ 

( #Ar(a:d,0,.. ,0) 

+ 

( #N{xd-l, ■ ■ ,X3) 

+ 

( #N{xd-l,..,X3) 


■ ■,yo) = 


X 

^N{yd, 0 , • • ,0) 

) 

[line 1] 

X 

#Ar(yd-i, ■. ,2/0) 

) 

[line 2] 

X 

#N{yd, 0 , • • ,0) 

) 

[line 3] 

X 

#N{yd-i, ■ ■ ,2/0) 

) 

[line 4] 


The multiplication in line 1 can be done via the formula as follows: Let 
and be the numbers which satisfy {xd, yd, 


‘'2d+l 


, and let = • • • = 


= 0. Obviously, #Ar(4dVl’4d , U 2 d-i, ■ ■, Uq^^) is the result of the multiplica¬ 
tion in line 1. 

The multiplication in line 2 can be done as follows: The formula ‘Pi helps to determine 


numbers vi^d+i^ ■ ■ > that 


,( 2 ) 


( 2 ) 


2d+15 ■ • J ' 


) = Xd X #N{yd-i, ■ ■ ,yo)- 

Furthermore, let = • • • = = 0. Clearly, #Ar(u 2 d+i’ 

the result of the multiplication in line 2. 

Analogously we obtain a tuple such that 4^Niu^2d+i^ '*^ 2 d-i> ■ ■ > '■h® 

result of the multiplication in line 3. 

Furthermore, ip‘^ directly gives us a tuple such that #N{,u^ 2 d-i^ ■ ■ is the 

result of the multiplication in line 4. 

For the addition of the numbers ^ _|_ 

make use of part (b) of Theorem 3.4. 

Altogether, this gives us the desired FO(+, x)-formula 


Step 2: We now construct the FO{+, x)-formula ifly{x,y, zi, zq), expressing that 
x-y = zi- (N+l) + Zq. 

Let M := [-yZ/Vj ■ The basic idea is the following: 

1. Move over from numbers x G {0,.., N} to their (M+l)-ary representations 
X = Ui- (M-bl) + uq for ui,uq G {0,.., M}. Note that this is possible for all 
X ^ N since ^ N < (M+1)^ = M ■ (M+1) + M + 1. 

2. Show that this decomposition can be defined by aFO(+, x)-formulax(a;, ui,uo) 
which expresses that x = 4 /^m{ui, uq). 

3. Construct a formula il}\ (ui, Mq, ui, Uq, 1113 , 1 x 2 , Wi, Wq) that defines the multi¬ 
plication for the (M-l-l)-ary representations. 

I.e., V'x expresses that uq) x uq) = #m{w 3 ,W 2 ,Wi,Wo). 

4. Show that x can be extended to a formula x'(zi, Zo,W 3 ,W 2 ,wi,wo) which ex¬ 
presses that #Ar(zi, zo) = #m{w 3 ,W 2 ,Wi,Wo). 

Afterwards, the desired formula Lp\ can be defined as follows: 

:p\y{x,y,zi,ZQ) := 3 ui,uo,wi,'!;o,W3,W2,Wi,wo {x{x,ui,uo) A x{y,vi,vo) f\ 

■!/>x (Ml,Uo,Wl,-yo, W3, W2, Wl,Wo) 
X'(2l.20,W3,W2,Wl, wo) ) . 
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Hence it suffices to construct the formulas x, V'x > x”- 

Of course, the formula 

C,m{z) := 3y [z X z = y ^ Mz' { z' > z ^ ^3?/' z' x z' = y' )) 

expresses, for underlying universe {0,.., A^}, that the variable z is interpreted with the 
number M := [-s/iVj. Consequently, the following formula x(a;,Mi,uo) expresses 
that X = uo) = ui ■ (M+1) + uq : 

x{x, ui,uq) := 3z 3v 3w ( C,m(z) /\ui^z/\uq^z/\ 

V = Ui X Z A W = V + Ui A X = W + Uq) . 


It is straightforward to obtain a formula 'tpl^{u,v,wi,wo) which expresses, for un¬ 
derlying universe {0, and interpretations of u,v,wi,wo in M}, that 

u ■ V = wi ■ (M-fl) -f Wo : 


tj;]^{u,v,wi,wo) := 3w (A w = uxv). 

In the same way as in Step 1 we obtain a formula Tp^. {ui,uq, vi,vo, W 3 ,W 2 ,wi,wo) 
which expresses, for underlying universe {0,.., N} and interpretations of u, v, w in 
{1,.., M}, that 

#m(u1,Uo) X #M{vi,Vf)) = #m{w3,W2,Wi,Wq) . 

All that remains to do is to construct a formula x'{zi^ zo,W 3 ,W 2 ,wi,wo) which ex¬ 
presses that #Ar(zi, zq) = Zi-{N+l)+Zo = PPm{w3,W2,Wi,Wo). 

Choose ai,aQ,bi,bQ,ni,ntj such that Zi = #M(ai,ao)j Zq = and 

N+1 = no). For zi and zq this can be ensured by the formula x; for A^-l-l it 

can be ensured by a straightforward variant of x- 

Obviously, 2 i-(iV-l-l) -I- zq = (#M(ai,ao) x #M(ni,no)) -I- #m(6i,6o)- Hence, 


Zi-{N+l)+Zo = PPm{w3,W2,Wi,Wo) 

if and only if 

(#M(ai,ao) X #M{ni,no)) +#m(&i,^o) = #m{w 3 ,W 2 ,Wi,Wo) ■ 


This multiplication and addition of (M-l-l)-ary representations can be done in a straight¬ 
forward way by using the formula ifj'^ and an according formula (obtained by a 
variant of part (b) of Theorem 3.4). Altogether, this gives us the desired formula x'- 
Finally, the proof of part (d) and, altogether, the proof of Theorem is complete. ■ 
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